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This memorandum contains a response to an article in 
"Change" magazine by Andrew Lupton# John Augenblick, and Joseph 
Heyison/ September 1976. The article presented the results of a study 
grouping a national sample of colleges and universities into 
categories according to their financia?. health. The author's 
reservations about the "Change" analysis extend to the period of time 
covered by the study^ the sample of institutions included, narrowness 
of the information base, application of discriminant analysis, 
axbitrarinebo of the scale of financial health, circularity in the 
model, measures of statistical confidence that were reported, use of 
the same indicators for both private and public institutions, 
interpretation of the key health indicators used, reliance on HEGIS 
data, and treatment of the panel ratings as a consensus on financial 
indicators. (MSE) 
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Subject: Comments on " The Financial State of Higher Education : A 
Special Report," by Andrew Lupton, John Augenbllck, and 
Joseph Heyison, Change » September 1976. 

Change magazine has Just published the results of a study by the 
staff of the New Jersey Commission on Financing Postsecondary Education 
In which a national sample of colleges and universities was grouped 
into five categories according to their financial condition, ranging 
from "healthy" to "unhealthy." These are the kinds of summary conclu- 
sions which are being widely quoted from the report: 

— Almost one-hal f of all academic Institutions can be 
considered to be In an unhealthy condition. (p. 25) 

— Private Institutions exhibit a severe skew toward the 
unhealthy end of the scale, with almost three out of 
every five schools in Category D [relatively unhealthy], 
(p. 23) [An accompanying chart shows 86.6 percent of the 
privato institutions in the two unhealthy categories.] 

In response to your questions about the validity of the Change 
report, I would say that the basic idea of combining the opinions of 
a panel of economic and financial analysts about what constitutes 
college and university financial health, with statistical procedures 
to identify indicators and group institutions by apparent financial 
condition* is a genuinely new approach which is worth pursuing. This 
approa(^h, along with a number of others, can be usefully tried for the 
Important pui poses of developing concepts of Institutional health and 
exploring the potential and the limits of existing data for policy- 
oriented financip.i analysis. The authors and the publisher of Change 
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magazine simply went too far, too fast, In drawing conclusions intended 
to Influence management decisions and public choices affecting the finan- 
cing of higher education. 

My reservations about the analyses are listed here. Most of the 
deficiencies could be remedied by refinement of the use of panel opinion 
and by further statistical and, most Important, further conceptual work. 
Making Improvements In the methodology, however, may well require the 
authors tc revise some of their sweeping conclusions. 

Period Covered by the Study^ 

Tlie opening paragraphs refer to *'thls 1976 report** and state that 
"over the last half year ... we have been able. In effect, to take a 
fluoroscopic picture of the state of Merlcan higher education,** imply- 
ing that the analysis covers current financial conditions. But actually 
the report is based on data for fiscal years 1972 through 1974: that is, 
for a period ending (for most institutions) in June 1974, more than two 
ytvirs ago. The Lanier-Andersen report on financial conditions of both 
public: and private institutions has data for fiscal 1975, and the most 
recent Bowen-Mlnter report on a panel of LOO private institutions has some 
data for 1976. 

1^1 Bowen, Howard R. and W. John Minter, Private Higher Education , 
First Annual Report on Financial and Educational Trends in 
the Private Sector of American Higher Education , Association 
of American Colleges, November 1975, Washington, D. C. 

, Private Higher Education, Second Annual 

Report on Financial and Educational Trends in the Private 
Sector of American Higher Education , Association of American 
Colleges, May 1.976, Washington, D. C. 

Lanier, I.yJe M. and Charles J. Andersen, A Study of the Financial 
Cond ition of Co J leges and Universities , American Council on 
f':cIucatIon Special F<ooort, Office of Administrative Affairs 
and Educational Statistics, October 1975, Washington, D. C. 



Text and captions reporting, for Instance, that the condition of 
most private colleges and universities "has drain..Llcally worsened" when 
compared with that of publicly supported Institutions, imply that finan- 
cial trends in the two sectors have been compared systematically. But 
It Is not clear how explicitly trend analysis has been incorporated 
into the discriminant analysis employed in the study. Of the 16 vari- 
ables used to characterize the health of institutions, only four are 
trf^nd variables; two describe types of institutions, and the ten finan- 
cial ratios relate to a single year, fiscal 1974. 

The period of years cov Jed in the financial analysis is also 
extrer important: Interpreting trend data for higher education 
requires f king into account the impact of general economic cycles on 
the health of academic institutions. Though the authors of the report 
recognize the importance of this impact, they do not make clear what 
bearing general economic conditions during the period covered by their 
data have on Interpretation of their findings. In 1972, the economy 
w;iM moving out of the contraction of the early 1970s; in 1974, it wis 
moving inlo the contraction of the mid--l970s. To take business cycle 
phenomena more adequately into account would require either selecting 
for analysis a period that corresponds to at least one full cycle or 
else modifylig the interpretation of the trend data so as to offset 
th</ distortions that result from starting the period of analysis 
c lose I a peak in a > yde and ending it close to a trouj^h. 

A cla5ksic shortcoming of financial analysis for higher education 
is information la^,s, which may be of sufficient magnitude to render 
any policy prescriptions completely out of phase with "-ontemporary 
reall t les . 

4 
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Sainplc of Inst l Lutions Included in the Study 

In thlfl study, a random sample of 50 Institutions was drawn from 
the total Institutional population, and another five institutions were 
subsequently added for better coverage of private and graduate-level in- 
stitutions. But, in cases where the population to be studied is not 
homogeneous and where adequate representation of the components of the 
population is important, standard sampling technique requires, instead, 
that the initial sample be stratified. With a stratification design, 
the total sample is made of carefully drawn subsamples of each subgroup 
to be included in the analysis. Throughout the study, inadequate attention 
has been paid to the complex structure of American higher education. 

Later in the analysis, because of inadequate data, two of the insti- 
tutions labeled '^unhealthy*' were replaced by two other "unhealthy*' insti- 
tution.s. These two institutions constituted one-third of the six 
"unhealthy" institutions used in calculating the discrlxainant function to 
distinguish between healthy and unhealthy institutions. With a sample as 
small iiH this, the particular institutions selected can materially affect 
the conclusions, yet the criteria for selecting the institutions added to 
or replaced in the sample are never explained. 

Standard procedure in discriminant analysis with relatively small 
samples (under 200 cases) is to draw a second sample for cross-validation 
with the first. Internal cross-validation was clearly required in this 
Instance, where only 19 institutions were used in the initial discrimi- 
nant analysis, in order to test the stability of the results: that is, 
the stability of the variables selected to distinguish among the groups 
and the stability of the weights, or the relative importance, assigned to 
each variable. A different small sample could yield very different results. 

5 
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The base population of institutions from which the study sample 
was drawn comprised those institutions on the U^S. Office of Education's 
1974 HEGIS survey tape. The final analysis included 2,163 institutions 
witli adequate data and excluded 1,024 institutions with inadequate data. 
The total (3,187) is larger than the number of institutions reported in 
the Office of Education Directory as being in the 1974 population. This 
discrepancy needs explanation. 

Of the institutions excluded, 420 were public, and 604 were private; 
these figures represent about one-quarter of the public sector and one- 
third of the private sector. More detailed comparisons of the included 
with tbs? excluded institutions should be provided as a better basis for 
assessing the nature and degree of the biases that might have been intro- 
duced Into the analysis. Given the large amount of missing data, an 
improved procedure would involve matching "missing-data'* institutions 
with "complete-data'* in. titutions and devising a saiipling design that 
allows representation of the entire population* 

III the study as reported, we do not know precisely what population 
was studied- Therefore, any generalizations about national financial 
conditions based on this anilysis are less reliable than would be those 
drawn I rom more carefully defined samples of the population. 

Narrowness of the Information Base 

Tlie 55 institutions in the sample were ranked on a scale from 1 
(very unhealthy) to 5 (very healthy) by a panel of economic and financial 
analysts. The panel members were provided with 46 financial ratios along 
with trend data on enrollments, revenues and* expendl tures for each insti- 
tution for the three years from fiscal 1972 to fiscal 1974. Seven panel 
member;! participated In tiie ranking process; an eighth panel member declined 
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to rank the institutions on the grounds of insufficient data. The ratings 
were averaged and compared with an expected normal distribution, and insti- 
tutions at the extremes were categorized as "healthy" and "unhealthy." A 
total of 13 institutions were characterized as "healthy" and six as "unhealthy." 

Next, equations were derived, using variables associated with these 19 
institutions, to determine which variables did the best job of differentia- 
ting between the unhealthy and hoalthy institutions. These equations were 
u.sed to group the remaining 36 of the 55 sample institutions and then to 
group the 2,163 institutions in the national sample for which sufficient 
data existed. 

The 19 institutiotiK whose ratings formed the foundation of the study, 
are grouped, by type and control, as follows (the first number is the sub- 
total of ^ qtitutions ranked "with confidence" in the procedure, and the 
second number la the total of institutions in each cell of the sample 
of 55 institutions submitted to the panel: 

Public Private 



Four- Two- Four- Two- 

Unlverslty Year Year University Year Year Total 



Healthy 3/5 3/9 5/16 2/3 0/2 

Unhealthy 3/16 3/20 

19/55 

Of the 19 institutions used to derive the basic equation for discrim- 
inating between healthy and unhealthy institutions, only five are private; 
of these, two were rated "healthy" and three were rated "unhealthy." 

The ranking of the 19 Institutions (14 public and five private) 
carried much of the burden of the subsequent analysis as it is described 
in the Technical Notes to the article. This constitutes an extremely 
narrow base for making statements about the financial health of the 
nation's colleges and universities. 
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Application of Discriminant Analysis 

Discriminant analysis Is a statistical technique for defining a 
function (drawing a line or a plane) which does the best job of making 
groups of observations as statistically distinct as possible (maximizing 
the squared distances of the observations from the line or plane). 

Application of discriminant analysis as reported in this study in- 
volved two phases: first, defining distinct groups of institutions; and 
second, classifying previously unclassified institutions. The first 
phase was carried out in three stages: (a) defining distinct groups by 
means of the panel's ranking of financial health; (b) generating the 
equations which discriminated best among the groups, using as discrimi- 
nating variables selected institutional characteristics (financial 
ratios aud trend data) ; and (c) assessing how well the process worked 
by analyzing the degree of confidence with which the discrimination 
between the groups can be derived from the variables used in the equation 
The second part of the analysis was to group the previously unclassi 
fled Ins tltut:ions , using the weights from the equations based on the 
characteristics of the institutions classified in the first phase. 

In thGory» discriminant analysis is an appropriate technique for 
classifying institutions by financial condition; but in this case, the 
application was underdeveloped and thus was very shaky, '^roblems with 
this particular application included, at the outset, the incomplete 
consensus among the panel members in their initial ranking of insti- 
tutions — the ranking from which the discriminant function was derived. 
Not one of ihe 55 institutions was ranked in the same group by all 
seven p;me lists; Indeed, six institutions was ranked as "very 
healthy" and as "very unhealthy** at the same time by panelists who 

H 
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dld not agree with each other. The spread of ranlklngs across the five 
possible groupings was as follows: 



Number of Different Groups In Number of Institutions In the Sample 

Which Institutions Were Ranked: Total Public Private 



All panelists ranking In the 

sr.me group; 0 0 0 

Across 2 groups 8 6 2 

3 23 9 lA 

^ 18 11 7 

Across alJ 5 groups 6 A 2 

Total 55 30 25 



The validity of the entire analysis depends on the precision of 
the Initial grouping of Institutions, but as the preceding table Indi- 
cates, agreement among the panelists was not very high. 

•riie validity of the analysis also depends on the variables used 
to discriminate among the groups. To the extent that there Is error In 
the Initial groupings, this error affects the selection of variables— 
that 1b, the 16 key Indicators — used to Identify differences In financial 
health among the groups. 

For the purposes of the discriminant analysis ^ as described In 
■the Technical Notes, only two groups of Institutions, "healthy" and 
"unhealthy," were derived from the original panel rankings. One discri- 
minating equation was generated to differentiate between these two groups. 
But the report Itself presents data based on five It.. :1s of health; 
such a classification requires f e distinct groups, for which four 
discriminating equations could ba generated. 

-9 



Axbltrarlnesa of the Scale of Financial Health 

It is unclear from the one-page technical note precisely how the 
essentially relative rankings were transformed into absolute categories 
of financial condition. The initial rankings from 1 to 5 tend to be 
more relative than absolute because (ns the study waf? intentionally 
carried out) the panelists had no previously agreed-upon definition of 
financial health. Even the consistent application of chosen absolute 
standards by individual panelists (who may well have differed from each 
other) become? relative when cv^gregatec Because not a single one of 
the Institutions was ranked the .larae by all the panelists, when the ranks 
were averaged » the range was restricted to narrower limits than the 
original 1 to 5; it was narrowed to a 3.25-point spread from the possible 
5. Tlie authors then transformed the 3.25 spread based on relative rank- 
ings back into five absolute groups, labeled A (healthy) through E 
(unhealthy)^, and a ^'ery particular substantive meaning was attached to 
each group: for instance, "relatively unhealthy" is defined as a con- 
dition "which might be turned around by good management" and "unhealthy" 
as a situation "where the institution's long-term survival is proble- 
matic aniens some major external intervention occurs." These are the 
authors' Interpretations; they do not flow from the data as such, and 
they do not necrssai'lly reflect the formulations of the panelists who 
ranked the Institutions. 

The distribution of the panel scores was transformed so that the 
average score was set at zero and the scores of the rest of the insti- 
tutions were arrayed above and below that average. Designaf^on of the 
five categories of health were then set at Intervals one and thre<^ 
standard deviations above and below that average. But the deslgnat-^on of 
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"relatively unhealthy" 'w up to one Htandnrd deviation below the moau and 
"unhealthy" an more than one ntandard deviation below the mean le entirely 
arbitrary. 

UHlnv, this standard to support a statement that AO percent of the 
InotltutloHH arc "unhealthy" is equivalent to saying that AO percent of 
the population are "short." Forty percent of a normally distributed 
population wculd be in the bottom two categories defined by the authors 
filmply aa a result of t^le properties of a normal distribution. The 
statistical expectation that AO percent of the Institutions would, by 
def inlr ion, 'unhealthy" or "relatively unhealthy" tends to desensa- 
t tonal Iz-? the f inding that A9 percent of the institutions ate located in 
thef.e two cate^oriep. As a matter of fact, almost as high a proportion 
(A1 percent) of the institutions are located in the- "healthy" and 
"relatively unhealthy" categori-s, but the report does not emphasize 
to tliis point. 

Circul arity i n the M odel 

The discriminant analysis is technically flawed in several serious 
respects. Using the control and type of institutions (such as private, 
or twi^-year) as explanatory variables introduces circularity into the 
analysis. In calculating the financial health score, private institu- 
ttons at the outset are given a negative weight in the equation. Con- 
sequontly, taking n private L.'^tltutlon and a public institution which 
are exactly equal on every otiier variable used in the discriminant 
analysis, the private Institution would show up as less healthy than 
the public Ins*- Itut ion. Similarly, two-year institutions are piven 
a positive weight in computing the financial health score — so hat two- 
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yt»flr Iiuitltiit ions .;iit onui l Ici 1 1 y atv ^Ivi^n a lilKlu^r liralth ncurt' cvimi 
If thfy a^c nl)Nolul4»ly tdoutlcal In evt»ry other respccc to a four-ycnr 
*nfltit.ut ion. 

Further » If the varlablen used (o characterize the t" Inane Ini health 
of the instl utlon are not themHelven noraally cllwtr ibuted , then the 
compofllte ficores of the InBtltutlonfi will be skewed, not neccnaarllv 
bocaufle more Institutions than expected are ''unhealthy" but simply as 
an artifact cf the computational procedure. 

Still further, the model used In the analysis Is a linear model. 
In a linear model If something Is good, more of it Is bettor, ^at It 
Ir. entirely i)o55j?lbJe that some of the relationships between the variables 
tind financial liealth aie not linear:. Take, for instance, the ratio of 
current revenues to current expenditures, where a balanced budget (Indi- 
cated by a ratio of 1.0) may be healthy but cither lar^;;,e deficits 
(rntit) 0.8) or large stirpluses (ratio 1.2) may be unhealthy. 

Finally, there may be interaction effects among the variables which 
should be taken into account in the analysis. 

Measur e s of St at is t leal Confidence Reported 

In descrlblnj?. the .uialysis, the authors report measuring statistical 
confidence levels. The reader who does not have a technical background 
In statistics Is led to conclude from the.^e statements that the analysis 
Js solid. Hut the statements in the article about the levels of conli- 
dence of tiie statistical results are somewhat misleading. 

For Instance, iccordln^^, to the Technical Note: "Thift weighted scale 
contalnec! nvor ^^7 pprrent ol the disc Imlnatlng Info mat Ion present In 
the sample . . In a discriminant analysis where the number of expla- 

natory variables is gr.Mtcr t lan th^ total number of cases used in the 
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analysls, however, the system Is mathematically fully determined: that 

is, all of the differences among the groups are computationally "explained," 

but the explanation has very little substantatlve meaning. In fact, 

sets of random nonsense variables would also "explain" the grouping. 

At the outset, confidence levels; were used In deciding whether 
institutions at the extremes of the rankings were "healthy" or "unhealthy": 
'"Healthy institutions were labeled as such because the expert panel's 
average rating placed them far enough out on the 1 to 5 scale for one to 
say: 'There is only 1 chance in 100 that such a high rating resulted 
from pure chance.'" But computation of such confidence levels requires 
that the underlying data be normally distributed, which it may not be, 
and that the 1-5 scale be truly an interval scale, where the distance 
on the scale from 1 to 2 is the same as that from A to 5. The scale 
used by the panelists is probably more accurately described as a rank- 
ordering (i.e., ordinal scale) than as an interval s^ ile so that the 
statements about confidence levels are not quite so solid as they purport 
to be. 

Use of the Same Indicators for both Private and Public Institutions 

A fundamental concern is that the authors failed to ask a key 
question which is central to the analysis: are the same financial 
indicators equally meaningful for public and for private institutions? 
All the institutions were treated as one undifferentiated population. 
Control and type (such as private institution, or two-year college) 
were used to explain the differences in financial condition, rather than 
as variables for grouping the institutions with different governance and 
financial structures. Rather than assuming that the same indicators can 
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be used for all groups of Institutions, the authors should have posed 
this as the first question to be answered before proceeding any further 
with the analysis • 

Interpretation of the Sixteen Key Health Indicators 

The selection and Interpretation of the 16 key health Indicators 
reflects reliance on raw statistical results rataer more than on coherent 
understanding of the financial operations of higher education Institutions, 
And, as the authors acknowledge, there Is no confirmation that the sixteen 
variables selected by the statistical procedures for grouping the Insti- 
tutions according to financial condition were the ones used by the panel 
In their original rankings, but merely that by using these variables, 
the computer could '*mlralc" the rankings. 

A concept of long-run financial equilibrium has important implica- 
tions for the definition of financial health of higher education Insti- 
tutions. Pioneering work is being done on this concept by William Massy 
and David Hopkins at Stanford University. Andrew Lupton and John Augenbllck 
are familiar with this work and acknowledge Its significance, but they do 
not operatlonallze it in their analysis. This is evidenced by the 16 vari- 
ables selected by raw statistical procedures as "the most reliable" in 
indicating health. The variables are not yet Integrated into any coherent 
"theory of the educational firm" and consequently represent a rather mixed 
bag. 

This shortcoming in the analysis can be Illustrated by a number- 
of the authors' conclusions with respect to the indicators. Long-run 
financial equilibrium involves (a) levels of expenditures and revenues 
and (b) r ates of change in these financial flowe over time to insure 
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that they are Jn a sustainable relationship to each other. The raw 
statistics used In the analysis yield data from which the authors con- 
clude that rates of change in expenditures are more useful In determining 
financial health than are rates of change in revenues — yet it is the 
relationship between expenditures and revenues which is at the very cofe 
of a definition of financial health. 

Another conclusion drawn by the article is that increasing under- 
graduate enrollment is associated with health and that relatively slow 
growth in educational and general expenditures is also associated with 
healtlu But clearly a healthy institution must have a balanced relation- 
ship between enrollment growth and growth in educational and general 
expenditures . 

A high ratio of freshman enrollment to total undergraduate enroll- 
ment is associated with healthy institutions; yet this conclusion implies 
that the higher the attrition rate, the healthier the institutioa is. 

High tuition revenues in relation to student aid revenues (from 
outside sources) are associated with healthy institutions; the inference 
here is that those institutions which rely less on external funds to 
support student aid are in better financial condition. If this means 
that those institutions are healthiest which rely most on Internal 
funds to support student aid, we see here an example of the strange 
effects that can be produced when the type of institution is confounded 
with the type of student body: at some institutions, increases in 
internally funded student aid have been c' >sely associated with finan- 
cial exigcmcy. 

We are told that statistically the tuition/student aid revenues 
ratio and the tuition/student aid expenditures ratio are positively 
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correlated, and this is very likely. But the student aid burden which 
affects the financial conditions of institutions is the difference between 
revenues and expenditures, not the correlation between them. At many 
institutions, this difference constitutes a large student aid deficit, 
as general funds are spent in addition to the revenues earmarked for 
student aid. The student aid deficit is not among the 46 indicators 
tested but would seem to be a much tetter indicator of the effects of 
student aid on the financial condition of higher education institutions 
than the measures that were included. 

Many of the bizarre statistical results would disappear, I believe, 
if, instead of putting all institutions into a single statistical pot, 
the authors had first grouped them by financial structure and academic 
miflsion and then searched for meaningful indicators to make comparisons 
within and among groups. 

Throughout the analysis, financial health is associated with holding 
down costs. For instance, healthy institutions are those which have: 
~ lower growth rates of educational and general expenditures, 
~ larger decreases in expenditures for plant additions, 

— lower costs per degree awarded, and 

— lower plant assets per enrolled student. 

Educational diversity in the United States would be seriously jeopardized 
by making gross policy prescriptions on the basis of these conclusions about 
costs without first carefully considering^ the academic missions of different 
types of institutions and the relation of costs to the quality objectives 
of each type of institution. 

The analysis should be redone using institutional types as classi- 
fying rather than as explanatory variables, and the Implications 
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of the financial ratios that eii^rge from the ptatlstical analysis 
should be reexamined to see whether they may not in reality serve more 
to describe a type of institution than to explain Its financial condition 
as is the case, for instance, with the graduate FTE/undergraduate zitiuj 

Reliance on HEGIS Data 

The basic data for the analysis were taken exclusively from the 
HEGIS (Higher Education General Information Survey) reports made by 
institutions to the Office of Education. Analysts working closely with 
the HEGIS data have discovered large-scale omissions and inconsistencies. 
It Is true, however, that HEGIS data are the only data available on a 
national basis, and their use is often justified because the alteimative 
of generating new data from operating statements and balance sheets 
restructured for consistency across institutions, even if technically 
possible, is probably prohibitively expensive. 

There is, however, a still more fundamental difficulty with using 
HEGIS data to analyze the financial conditions of colleges and universi- 
ties. HEGIS data are constructed, as are institutional books, on 
traditional fund accounting principles, with separate accounts for each 
major source of funds. This accounting system was developed over the 
years to serve fiduciary requirements to report to those providing 
funds to academic institutions, not to serve the inform<?.tioa needs of 
the managers of operating enterprises. The basic problem in straight 
fund accounting Is that there is no "bottom line." A number of trea- 
surers of higher education institutions are experimenting with consoli- 
cated formats for their financial statements. It is unlikely that solid, 
dependable statements can be made about the general financial conditions 
of colleges and universities until innovations in the accounting fieiu 
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leading to a more comprehensive understanding of each Institution as 
a whole take hold over the next several years. Until that time, any 
generalizations about financial conditions cf colleges and universities 
will be vulnerable to serious challenge. 

Treatment of the Panel Ratings as ^'Consensus" on Financial Indicators 

The word consensus connotes active agreement rather than merely 
statistical averaging. At no time during the rating process, however, 
did the panel agree upon, or even discuss, what constitutes financial 
health. Only after the ratings were made, not before, did the authors 
use statistical technlquer to' attach meaning to the ratings. Up to 
this point In the analytic process, the panel had not reached a con- 
sensus, In the common sense of the word, on: 

— how financial health should be defined, 

— how the relative ranking of the Institutions is related to 
the definition of health, 

~ which Indicators are most useful In assessing health, and 
whether they are equally applicable to both public and 
private Institutions, 

— how the indlcatoio finally selected for characterizing 
financial condition should be Interpreted, or 

— whether the c^' . - ai] conclusions about the health of the 
nation's colleges and universities as reported In the 
irtlclo are valid. 

The analysis underlying the Change report Is Incomplete. It cannot 
currently be used as a solid foundation for deriving conclusions about 
the financial health of all Institutions, nor for financial self-study by 
Individual Institutions. 
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lliis memorandum iu based on the report as published and on tabula- 
tions of Institutional rankings sent to the panelists who participated 
In the first phase of the study. A more extended technical documenta- 
tion of the procedures which Is being prepared by the authors was not yet 
available. Only two of the panelists saw the report In draft form before 
It was published . 

In preparing this memorandum a number of people contributed helpful 
Insights and Information: Paula Knepper and A. Jackson Stenner on 
discriminant analysis, Cathy Henderson on HEGIS data, and Sharon L. Coldren 
and Ben Laden on interpretation of financial Indicators. John Mlnter also 
provided the results of a special analysis of the data which he performed 
and submitted to the New Jersey staff as the justification for his bat^^ic 
reser\^atlons about the ranking procedure. 
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